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Preface 

This  work  represents  the  outcome  of  my  attempt  to 
formulate  and  solve  a  two  spacecraft  encounter  viewed  as  a 
differential  game.  The  vehicles  are  constrained  to  maneuver 
in  only  two  dimensions,  but  the  gravity  field  is  allowed  to 
vary  as  a  function  of  altitude.  Much  of  the  work  centers 
around  pseudo  linearized  equations  of  motion.. 

1  wish  to  express  my  appreciation  to  the  faculty  members 
of  the  Air  Force  Institute  of  Technology  who  have  either 
Influenced  or  assisted  me  in  this  effort.  In  particular,  I 
am  indebted  to  Prof.  Gerald  M.  Anderson  for  introducing  me 
to  the  field  of  optimization  theory  and  for  guiding  my  thesis 
effort . 
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Abstract 

This  paper  considers  the  problem  of  developing  the 
optimum  thrust  angle  prograas  for  two  constant  aass,  constant 
thrust  spacecraft  engaged  in  pursuit  and  evasion  in  near- 
earth  orbit.  The  problea  is  foraulated  as  a  differential 
gaae  in  which  the  pursuer  attempts  to  ainiaite  the  final 
separation  distance  while  the  evader  attempts  to  maximize  it. 

The  problem  is  approached  by  linearizing  the  equations 
of  motion  about  a  circular  reference  orbit  at  the  earth's 
surface.  The  validity  of  the  linearized  equations  is 
verified  by  comparing  a  linearized  trajectory  to  six  non¬ 
linear  trajectories.  Optimum  non-linear  trajectories  are 
generated  by  backward  integration.  The  fixed-time  and 
free-time  two  point  boundary  value  problems  are  solved  for 
the  linear  case.  It  is  found  that  convergence  tc  a  free-time 
solution  becomes  exceedingly  difficult  if  the  flight  time  is 
short . 

A  pseudo  closed  loop  control  law  is  developed  and  tested 
numerically  against  two  non-optimum  evaders.  The  results  of 
this  control  law  test  are  promising  but  further  tests  are 
warranted  due  to  the  limited  number  of  cases  considered. 
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PURSUIT-EVASION  GAMES  BETWEEN  TWO  SPACECRAFT 
IN  NEAR-EARTH  ORBIT 

I .  Introduction 

Background 

The  advent  of  viable  military  -pace  systems  by  poten¬ 
tially  agressive  foreign  powers  has  raised  the  possibility 
of  our  country’s  earth  satellites  coming  under  hostile 
attack.  Such  a  possibility  has  prompted  a  need  for  an 
Investigation  to  determine  the  optimum  methods  of  avoiding 
destruction  or  capture  in  the  event  of  such  an  encounter. 

Problem 

This  study  analyzes  the  pursuit-evasion  situation 
through  the  use  of  differential  game  theory.  The  specific 
situation  investigated  is  the  two  dimensional  (planar) 
problem  in  near-earth  orbit  with  the  final  separation  dis¬ 
tance  between  the  two  vehicles  being  the  zero  sum  payoff.- 
Both  the  fixed  and  free-time  problems  are  discussed. 

Current  Knowledge 

There  has  been  much  successful  work  over  the  last 
decade  using  differential  games  to  investigate  aircraft 
pursuit-evasion  problems.  However,  there  have  been  but 
relatively  few  attempts  to  utilize  this  game  technique  in 
the  study  of  orbital  problems.  Billik  (Ref  2)  used  differ¬ 
ential  games  to  solve  the  minimum  energy,  fixed-time  problem 
in  an  inverse  square  gravity  field.  Wong  (Ref  4)  used  the 
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sane  technique  to  investigate  the  fixed-tine,  nininun  final 
separation,  assuaing  that  the  encounter  took  pli.-e  in  a 
region  where  gravity  was  constant.  To  date,  there  apparently 
have  been  no  published  solutions  to  the  niniaua  distance, 
free-tine  problea  in  an  inverse  square  gravity  field.  The 
absence  of  solutions  is  probably  due  to  the  complications 
which  arise  prinarily  due  to  the  free-tine  aspect  of  the 
problea. 

Scope 

This  thesis  will  consider  the  ainiaum  distance,  fixed 
and  free-tiae  probleas  in  an  inverse  square  gravity  field. 
This  study  will  consider  only  the  end  gaae,  that  is,  the 
situation  after  the  pursuer  has  closed  to  within  about  100 
nautical  ailes  of  the  evader  and  is  continuing  to  close. 

This  aagnitude  of  distance  has  been  selected  as  a  aaxiaua 
range  for  an  on-board  radar  systen.  Not  considered  will  be 
any  action  on  the  part  of  either  vehicle  before  that  situa¬ 
tion  is  reached,  that  is,  gross  rendetvous  will  not  be  con¬ 
sidered.  Also,  this  thesis  will  consider  the  fornulation  of 
both  open  loop  and  closed  loop  control  laws. 

Assuaptlons 

The  assumptions  to  he  made  follow.  Where  applicable, 
a  brief  explanation  is  offered. 

1.  Free  time.  The  overall  objective  is  to  solve  the 
free-tiae  problea  as  it  is  felt  that  this  is  a  sore  realistic 
situation  than  constraining  the  tine  of  gaae  teraination. 
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However,  in  the  course  of  obtaining  frce-tine  solutions, 
fixed-tine  solutions  are  a  natural  stepping  stone.  The 
fixed-tine  solutions  are  also  important  in  their  own  right 
and  are  useful  for  nodeling  certain  scenarios,  such  as 
Halted  fuel  cases. 

2.  Inverse  square  gravity  field. 

3.  Both  vehicles  thrust  continuously.  Once  either 
vehicle  discontinued  thrusting,  the  situation  could  froa 
that  point  on  no  longer  be  considered  a  two  player  gane.  If 
the  pursuer  ceased  thrusting,  the  evader  would  then  have  a 
siaple  avoidance  problea.  If  the  evader  quit  thrusting,  the 
pursuer  would  have  a  simple  intercept  or  rendezvous  problea. 
The  latter  situation  has  already  received  considerable 
attention. 

4.  The  thrust  aagnitude  of  each  vehicle  is  fixed. 

Even  with  variable  thrust  engines,  the  players  would  find 
it  aost  advantageous  to  use  aaxiaun  thrust  for  naximun 
control . 

5.  Control  is  provided  by  varying  the  direction  of 
thrust . 

6.  Payoff  will  be  the  separation  distance  at  problea 
teraination.  for  the  free-tine  problea,  this  will  be  at 
the  point  of  closest  approach.-  The  effectiveness  of  the 
pursuer  will  be  related  to  how  close  he  can  get  to  the 
evader.  The  evader,  on  the  other  hand,  will  desire  to  aaxi- 
aize  that  separation  distance. 

7.  Perfect  information.  Each  vehicle  ■•'ill  be  aware  of 
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the  current  state  and  capabilities  of  both  vehicles. 

S.  Fixed  mass.  This  eliminates  one  area  of  extreme 
complications  which  could  be  a  study  in  itself.  This  assump¬ 
tion  is  a  good  approximation  when  considering  low  thrust  and 
relatively  short  burn  durations.;  In  addition,  the  larger  the 
vehicl:,  the  less  is  the  introduced  error.; 

9.  No  barriers  or  ill-defined  surfaces.  That  is,  it 
will  be  assumed  that  the  solution  in  the  small  is  valid. 

Approach 

1.  linearize  the  equations  of  motion  about  a  circular 
reference  orbit. 

2.  Set  up  appropriate  equations  for  a  differential  game 
formulation  of  both  the  linear  and  non-linear  equations. 

3.  Apply  the  necessary  conditions  for  the  optimal 
minimax  solution  as  dictated  by  general  optimization  tech¬ 
niques  . 

4.  Compare  an  open  loop  linear  trajectory  to  open  loop 
non-linear  trajectories  to  check  the  validity  cf  the 
linearized  formulation  with  respect  to  the  end  conditions. 

5.  Solve  the  linear  fixed-time  two  point  boundary 
value  problem  (TPBVP)  by  using  sets  of  initial  conditions 
obtained  from  the  open  loop  non-linear  trajectories.  This 
will  allow  comparison  of  the  linear  and  non-linear  trajec¬ 
tories  with  respect  to  the  initial  conditions. 

6.  Extend  the  TPBVP  solution  to  the  free-time  case. 

7.  Develop  and  test  a  form  of  a  near-optimal  closed 
loop  control  law  for  the  optimal  trajectory. 
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I 1 .  General  Equations 


Non-linear  Equations  of  Motion 

Almost  any  text  oh  dynanics  can  be  consulted  for  the 
general  equations  for  two  dimensional  orbital  notion.  They 
are  as  follows: 


re2.^ 

r 


T  sin  a 


(i) 


rfl  ♦  2r6  » 


T  cos  a 


(2) 


where 


Vr  *  r 


(3a) 


and 


V6  «  re 


(3b) 


Making  use  of  these  velocities,  we  can  replace  the 
terms  in  Eqs  (1)  and  (2)  involving  r,  r,  0  and  0  to  yield 


V*  *  r 


0  -u  .  T  sin  a 
_2  a 


(*«) 


V„  ♦ 


V  V 

rv0  T  cos  a 


«b) 


1 


Where  as  shown  in  Fig.  1,  a  is  Measured  froa  the  local  hori¬ 
zontal.'  It  i»  desirable  to  have  these  equations  in  terns  of 
the  radial  and  transverse  velocities,  Vr  and  V0  respectively. 


The  above  are  the  non-lincar  equations  of  notion.. 
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where  now  r,  V.  and  V  refer  to  some  reference  orbit  and  the 
o  r 

delta  quantities  refer  to  deviations  from  that  reference 
orbit.  Letting  the  reference  orbit  be  circular  allows  the 
following  sinplif ications : 


and 


Vf  «  0 


a  2  U 
re  »  —a 


Using  the  above  in  Eqs  (6)  and  (7)  yields 


Av  .  !V!a « la*  uhjl 

r  r  y2  a 


(8a) 


O 


VVr 


T  cos  a 


(8b) 


Equations  (5)  and  (8)  are  now  the  linearized  equations  of 
■otion . 


Non-linear  Separation 

Figure  2  illustrates  the  geometry  involved  with 
determining  the  separation  distance  between  two  orbital 
vehicles,  hereafter  called  a  pursuer  ( P )  and  an  evader  (E). 
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higher  order  terns  on  the  assumption  that  fir  «  r,  the 
following  is  obtained. 

d2  -  (Arp  -  Ar£)2  ♦  r2(A6p  -  A6£)2  (11) 

normalized  Equations 

It  should  be  noted  that  the  numerical  values  of  parameters 
such  as  r  and  V  will  differ  by  several  orders  of  magnitude, 
that  is,  V  may  be  several  miles  per  second  while  r  may  be 
several  thousand  miles.  Because  of  this  computation  that 
involves  both  parameters  may  result  in  information  being  lost 
due  to  a  lack  of  significant  digits.  To  avoid  this,  it  is 
desirable  to  normalize  the  equations  of  interest  so  that  all 
parameters  will  be  of  the  same  order  of  magnitude.. 

This  author,  like  so  many  before  him  chose  to  normalize 
the  equations  with  respect  to  a  circular  orbit  at  the  sur¬ 
face  of  a  spherical  earth.  Thus,  distances  become  normalized 
by  rQ,  the  radius  of  the  earth  surface  orbit,  while  the 
velocities  become  normalized  by  VQ,  the  transverse  orbital 
velocity  of  that  circular  orbit. 

The  use  of  a  circular  orbit  allows  one  to  simplify  the 
gravitational  constant  u.  Since  jj  equals  the  product  of  any 
circular  orbit's  velocity  squared  and  that  circular  orbit’s 
radius,  the  use  of  a  circular  orbit  allows  the  value  of  u  to 
be  replaced  by  simply  unity. 
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It  should  Immediately  be  pointed  out  that  the  normaliza¬ 
tion  is  not  without  its  drawback.  The  unit  of  time  must  also 
become  non-dimensional..  Thus,  introduce  a  non-dimensional 
characteristic  time  unit 


T 


£12) 


This  will  necessitate  changing  the  time  derivatives  to  tau 
derivatives  by  use  of  the  chain  rule  for  differentiation. 


d<  )  .  iU.  It  lo  d(  ) 
dt  dt  dt  VQ  dt 


(13) 


Sinca  differentiation  with  respect  to  time  is  indicated 
by  a  dot,  differentiation  with  respect  to  tau  will  be 
denoted  by  a  prime,  hence 


V' 

r 


Non- linear  Normal  i zat ion 

Using  the  aforementioned  procedure,  it  is  now  possible 
to  normalize  the  non-linear  equations.  First  define  the 
following  normalized  state  variables. 


x 


1 


(14a) 


*2 


(14b) 


J 


J 
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Q 


O 


(14c) 

(Md) 

Then  neking  u-e  of  Eq  (13), 

xj  *  x2  (IS*) 

Likewise, 


dx2  rfl  dx2 

*r‘7-0zr- 


'_0  1_ 

V  V 
0  0 


T  sin  a 


r  r2 


x.  2 

1  Xj 


rQ  T  sin  a 


By  defining 


V 

vo2  » 


where  both  T  (thrust)  and  a  (mass)  remain  constant,  the  last 
equation  can  be  written  as 


4  1 

x'  »  - —  -  — j-  ♦  u  sin  a 

t  Xj 


(ISb) 


i 

i 
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Equations  (3b)  and  (13)  yield 


USc) 


Finally, 


x 


4 


u  cos  o 


(lSd) 


Equations  (15)  now  are  the  normalized,  non-linear  state 

equations.  The  square  of  the  non-linear  separation,  Eo,  '9), 

2 

can  also  oe  noroalized.  Let  the  result  be  called  D  . 

D  *  X1E  *  X1P  *  2x1Ex1P  C0S  ^x3P  '  XSE^  *16^ 

linearized  Equations 

Using  the  sane  procedure,  it  is  possible  tr  noraalize 
the  linear  equ.tions.,  Define  the  following  noraalized 
linear  state  variables. 


Ax 


1 


(17a) 


Ax 


2 


(17b) 


AXj  •  A9 


(17c) 


Ax 


4 


(17d) 
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Now  woking  use  of  Eq  (13)  and  tht  linear  equations,  the 
state  equations  can  be  derived. 


AxJ  » 


(18a) 


.  .  2VoAX4  V9  r0  ixl 

Axi  *  ~v —  *  ;-rr 

0  V0  r 


(18b) 


where  u  is  again  defined  as 


V 

vo'«  ‘ 


Also, 


rflAx  rn  vnAxi 
Ax'  -  -  -3-J 

3  1  rZV„ 


(18c) 


and  lastly. 


Ax! 


-roVx2 

rV„ 


(18d) 


Observation  of  Eqs  (18)  yields  the  conclusion  that 
considerable  simplification  could  be  nade  if  the  reference 
orbit  used  for  linearizing  were  identical  to  the  orbit  used 
for  normalizing;  i.e.,  r  *  rQ  and  V0  *  Vq.  Making  that  very 
siaplification,  the  following  normalized,  linearized  state 
equations  follow: 


Ax j  «  Ax2  (19a) 

Ax£  *  2A*4  ♦  AXj  ♦  u  sin  a  (19h) 
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AxJ  »  Ar-4  -  AXj  (19c) 

AxJ  *  -Ax2  +  u  cos  a  (19d) 

As  before,  Eq  (11)  c»n  also  be  nornalized  to  yield 

9  *  (ixjp  *  *  (Axjp  '  ix3E^ 

It  should  be  noted  here  that  the  state  equations, 

Eq  (19), are  only  linear  in  the  states.  Those  equations  are 
not  linear  in  the  control  angle  a.  Thus,  even  though  they 
will  be  referred  to  as  linear  equations,  the  reader  should 
be  aware  of  the  non-linearity  involved  in  the  control 
function. 


o 
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III.  Differential  Cane  Fornu lation 

The  formulation  of  the  problems  herein  follows  the 
standard  pattern  described  in  Bryson  and  Ho  (Rof  2) .  The 
quantity  to  be  miniraaxed  is  the  square  of  the  final  separa¬ 
tion  distance.- 

In  the  free-tine  problem,  the  final  separation  distance 
will  be  the  minimum  separation  distance  and  the  final  time 
will  thus  cccur  at  the  point  of  closest  approach.  This 
separation  distance  at  the  point  of  closest  approach  is 
the  quantity  that  the  pursuer  desires  to  minimize  while  the 
evader  wishes  to  maximize  it. 

In  the  fixed-time  problem,  there  are  no  assurances 
that  the  final  separation  distance  will  be  the  point  of 
closest  approach.  However,  if  one  would  solve  a  large 
number  of  different  fixed  tine  problems,  all  with  the  same 
initial  states,  the  final  separation  distance  of  one 
particular  solution  would  be  less  than  any  of  the  others. 
That  one  particular  fixed-time  solution  would  then  also 
be  the  free-time  solution.  Thus,  the  solution  to  the 
free-time  problem  is  also  the  solution  to  one  particular 
fixed-time  problen.:  Hence,  the  technique  used  by  this 
author  to  solve  the  free-time  problem  was  simply  to  find 
that  particular  fixed-time  solution  whose  final  states 
corresponded  to  the  point  of  closest  approach. 
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I 


o 


o 


For  that  reason,  both  the  free  and  fixed-tiae  two  point 
boundary  value  probleas  will  be  presented  here  in  linearized, 
noraalized  form,  suitable  for  numerical  solution.  In 
addition,  the  non-linear  normalized  free-time  two  point 
boundary  value  problem  will  also  be  presented.  The  main 
purpose  of  the  non-linear  formulation  is  to  serve  as  a 
comparison  for  the  linear  approximation  formulations. 


Won-linear  Free-time  TPBVP 

The  non-linear  state  equations.  Eqs  (15),  plus  the 
range  squared  expression,  Eq  (16),  forn  the  basis  for  this 
analysis.  Both  the  pursuer  (P)  and  evader  (E)  have  identical 
state  equations. 


*1P  *  X2P 
x  2 

*jp  *  ifr  ■  t~2  +  up  sin  “P 
1  X1P 


(21a) 


(21b) 


A 


I 


x  *  *  — 

*3P  x 


4P 

IP 


(21c) 


*  -  —  *  “P  =0S  “P 


(21d) 


x  *  ■  V 

X1E  2F. 


(22a) 


o 


XJe  *  ^rr '  r1 '  sin  “e 

X1E 


(22b) 
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X2£X4E 

X4E  *  *  -1~-  *  UE  C0S  °E 


The  payoff  J  becomes  the  normalized  range  squared 
expression,  Eq  (16) , evaluated  at  the  final  time. 


J  '  xlEf  *  xlPf  *  2xlEfxlPf  cos  ^xJPf  ’  x3Ef5  ^23) 


The  main  equation,  or  Hamiltonian  (H) ,  can  be  formed 
by  adjoining  the  costates  to  the  state  equations.  Thus 

H  ’  xipx2p  *  x2P  [xfjr  *  *  7  4  Up  sin  °p] 


fm**  [- 

xip  4P  L 


♦  u  cos  a 
X1P  f 


X1EX2E  *  X2E 


[X4E2  .  JL 

LX1H 


2  *  UE  Sl"  °E 


+  X»  l2  *  X4E 


Using  the  relationship  X!  =■  -  t— —  ,  the  costatc 

X  O  X  ^ 

differential  equations  can  now  be  formed.. 
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®  X[p '  ^7  l>  (x<pJ '  * x 


3PX4P  *  X4PX2PX4p]  (2S,) 


x.  .  .x  ♦  N-^fp 

A2P  A1P  x. 


L1P 


(25b) 


xip  -  o 


(2Sc) 


,  .  2X2PX4P  X3P  .  A4PA2P 

4P  “  "  x,„  ‘  x.„  x. 


IF  IP  IP 


(25d) 


4E  *  x\  [X2E  (X4E2  *  )  * 


X3EX4E  '  X4EX2EX4e]  (26a) 


X,  .  .x  ♦  ****<£ 
*2E  *1E  x. 


IE 


(26b) 


X*  *  0 
a3E 


2X2EX4E  X3E  ^  X4EX2E 


4E 


X1E  X1E  X1E 


(26d) 


Also  from  the  min  equation,  Eq  (24),  the  optimum 


thrust  angles  can  be  found.  Using  the  necessary  condition 


that  §£  -  0, 


an 


-  X2pUp  cos  ap  -  )4pUp  sin  ap 


1 
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Froa  which 


2P 

tan  a  -  r — 
r  A*P 


That  is,  either 


sin  ap  »  - 


2P 


*  X4P2 


(27a) 


and 


4P 


n/X2P2  *  X4P2 


(27b) 


-A 


2P 


VA2P2  *  X4p2 


(28a) 


and 


-A 


4P 


^  D  ♦  A 


2  ♦  A  2 
2P  A4P 


(28b) 


o 


Likewise,  it  can  be  shown  that 

X2E 

tan  a  ■  i 

E  *4E 
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That  is,  either 


and 


sin  a£ 


cos  aE 


X 

V*2E 


4E 

y 


or 


and 


sin  ae 


2E 


X  ^  ♦  X  * 
2E  4E 


cos  aE  « 


4E 


.  2  ,  2 
X2E  *  X4E 


(29a) 


(29b) 


(30a) 


(30b) 


The  decision  concerning  which  signs  to  use  can  be  nade 

by  considering  the  sufficiency  conditions.  These  are,  for 
32H 

the  pursuer  - 5-  >  0  since  he  is  attempting  to  minimize  the 

3‘u 

cost  and  for  the  evader  - =■  <  0  since  he  is  attempting  to 

3“e 

maximize  the  payoff.  Thus,  for  the  pursuer 


-  X2PUP 


sin  op 


0 


X4PUP 


cos  op 


(31) 


21 


r 


o 


CA/MC/72-7 

i 

It  can  be  seen  that  to  satisfy  the  pursuer's  sufficiency 
condition,  Eq  (31),  that  the  expressions  with  the  ninus 
signs,  Eqs  (28)  must  be  the  optimal  solutions. 

Now,  for  the  evader. 


7  2  *  -  X2EUE  Sin  aE  *  X4E°E  C0S  *E 


o 


<  0  (32) 

In  this  case,  to  satisfy  the  evader's  sufficiency 
condition,  the  angle  expressions  with  the  plus  signs  must 
be  chosen,  Eqs  (29). 

Now,  in  an  actual  encounter,  the  initial  states  would 

be  known,  but  the  end  states  would  not  be  known.  The  trans- 

versality  conditions,  however,  would  allow  determination  of 

3  J 

the  costates  at  the  final  time  from  the  relation  X^  «  . 

These  are  as  follows: 


XlPf  *  2*xlPf  '  xlEf  C0S  (x3Pf  '  *3Ef^ 


(33a) 


o 


X2Pf 


X3Pf  * 


*4Pf 


X lEf  * 


0 


2txJEfXlPf  Sin  {X3Pf  '  X3Ef^ 
0 


2^XlEf  ‘  XlPf  C0S  (x3Pf  "  X3Ef^ 


(33b) 

133c) 

(33d) 

(34a) 


I 
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'2xlEfXlPf  Si"  C*3Pf  *  X3Ef* 


X4Df  *  0 


Since  the  cost  is  not  >  function  of  the  final  time,  the 
transversality  condition  also  gives  the  fact  that  H(Tj)  «  0. 
In  addition,  since  the  Hamiltonian,  Eq  (24),  is  not  an 
explicit  function  of  time,  then  H*  *  0  and  thus  for  any 


point  in  time 


H(t)  »  0 


Hence,  !.  must  equal  zero  at  the  final  time  T^.. 
Evaluating  Eq  (24)  at  xf  and  utilizing  the  transversality 
conditions,  Eqs  (33)  and  (34),  for  the  costates  yields 


0  "  x2EfxlEf  *  x2PfxlPf 


*  (x2EfXlPf  *  XlEfX2Pf)  C0S  (X3Pf  *  X3Ef5 


*  (xlEfX4Pf  ’  XlPfX4Ef)  si"  (X3Pf  '  X3Ef*  t36) 


For  this  free-timo  formulation,  the  stopping  condition 
occurs  when  the  vehicles  reach  the  point  cf  closest  approach. 
More  formally,  the  problem  would  end  when  the  range  rate 
between  the  two  vehicles  reaches  a  zero  value.  This  would 
also  correspond  to  the  point  where  the  range  squared  rate 
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retches  zero.-  It  has  already  been  shown  that  the  expression 
for  range  squared  is 

D  *  X1E  *  X1P  '  2x1EX1P  c0s  ^x3P  "  X3E* 

This  expression  can  be  differentiated  to  yield  an  equation 
for  range  squared  rate.  Performing  the  differentiation 
yields 


U  *  2x1EX1E  *  2xiPXlP  ‘  2x1EX1P  C0S  ^X3P  ‘  X3EJ 


2X1EX1P  C0S  ^x3P  "  X3E^  *  2x1EX1PX3P  Sin  ^X3P  "  X3E^ 


*  2x1EX1PX3E  Sin  (X3P  *  X3E} 


(37) 


Substituting  the  appropriate  state  equations,  Eqs  (15),  for 
the  primed  quantities  in  Eq  (37)  yields 


D  »  2x2ExJE  ♦  2x2pXjp  -  2x2£Xjp  cos  (xjp  -  xJ£) 


*  2x1EX2P  C0S  ^x3P  ‘  X3E^  *  2x1EX4P  sin  ^X3P  ‘  X3E^ 


-  2xjpX4E  sin  (xjp  "  XJE) 


2^X2EX1E  *  X2PX1P  *  ^X2EX1P  *  X1EX2P^  C0S  ^X*P  ’  X3F^ 


3P  3E' 


*  *Xl£X4P  ‘  X1PX4E^  Sln  fx3P  *  X3E^ 


(38) 
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Note  that  if  one  sets  Eq  (38)  equal  to  zero  at  the 
final  tine  to  forn  the  appropriate  stopping  condition,  the 
result  is  identically  equal  to  the  final  Hamiltonian 
expression,  Eq  (36)!  Thus,  the  stopping  condition  actually 
yields  no  additional  information. 

Thus,  the  non-linear,  normalized,  free-tiae  two  point 
boundary  value  problem  consists  of  the  state  equations, 

Eqs  (21)  and  (22),  the  costate  equations,  Eqs  (25)  and  (26), 
the  payoff,  Eq  (23),  the  Hamiltonian,  Eq  (24),  the  optimum 
control  angles,  Eqs  (28)  and  (29),  the  transversality  condi¬ 
tions,  Eqs  (33),  (34)  and  (35)  plus  the  initial  values  of 
the  states.. 

Linear  Free-time  TPBVP 

The  linear  state  equations,  Eqs  (19),  plus  the  range 
squared  expression,  Eq  (20),  form  the  basis  for  this  formula¬ 
tion.  As  in  the  non-linear  case,  both  the  pursuer  (P)  and 
evader  (E)  have  identical  state  equations. 

A*1P  *  Ax2P  (J9a) 

ix2P  '  2fix4p  ♦  fixip  ♦  up  sin  Cip  (39b) 

Axjp  *  Ax4p  -  Ax jp  (39c) 

Axjp  «  -A*2P  *  UP  C0S  CP  (39d) 
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Ax'e  -  ix2£  (40a) 

AX2E  *  2AX4E  *  iXlE  *  UE  £i"  “E  (40b) 

AX3E  *  4X4E  *  ixlE  {<0C) 

AxJ£  •  -Ax2E  ♦  u E  cos  a£  (40d) 

The  payoff,  J,  becomes  the  normalized,  linearized  range 
squared  expression,  Eq  (20)  ,  evaluat.-d  at  the  final  time: 

J  *  t4xipf  "  Axi£f5  *  ^AxSPf  *  Ax3Ef^ 

The  Hamiltonian  becomes 
H  »  AX jpAx2p  ♦  AX2p(2Ax4p  ♦  AXjp  ♦  up  sin  ap) 

♦  AXJp(Ax4p  -  Axip)  ♦  AX4p(-Ax2p  »  up  cos  ap) 

♦  AX1£Ax2E  ♦  AX2£(2Ax4E  ♦  Ax1E  ♦  uE  sin  a£) 

♦  AXJE(Ax4E  -  Ax1E)  ♦  AX4E(-Ax2£  ♦  uE  cos  aE)  (42) 

Using  Eq  (42),  the  costate  differential  equations 
become 


4Mf-  *  *4X2F  *  4X3P 


(43») 


AX<p  •  -AXJp  ♦  AX4p 


(43b) 
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aHp  *  o 


AX4P  ’  *2iX2P  '  4X3P 


AXh  *  -AX2E  *  AX3E 


AXk  -  -4*ie  ♦  AX4E 


AX3E  *  0 


AX4E  *  -2AX2E  -  AX3E 


The  optimua  thrust  angles  can  be  found  from  the 
sary  conditions.. 


5^  "  ° 


”  *X2p  up  cos  ap  -  &X4p  Up  sin  ap 


Fro*  which. 


4X,p 

tan  “f  *  T. 5^77 


(43c) 

(43d) 

(44a) 

(44b) 

(44c) 

(44d) 

neces- 


As  before,  either 
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o 


[ 

and 


cos  Op  * 


AX 


4P 


a/4X 


2P 


AX 


4P 


or 


AX 


sin  tip  • 


2P 


a/*X2P  *  AX4P 


and 


AX 


COS  Op  »  - 


4P 


iX2pI_:^X4p2 


o 


likewise  it  can  be  shown  that 


.  AX2E 


where  sicilar  choices  are  available-  Either 


sin  a.  = 


AX 


2E 


-/ 


'“«*  *  “.b! 


and 


AX 


4E 


o 


AX2E2  *  4X4E2 


(45b) 


(46a) 


(46b) 


(47a) 


(47bj 
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sin  a£  *  -  — . . .  (48s) 

and 

4X4E 

cos  aE  * - - —  ~  -  (48b) 

^iX2E2  *  iX4Ef 

The  correct  signs  are  determined  by  the  sufficiency 
conditions  as  Mas  done  before  in  Eqs  (31)  and  (32).  To 
satisfy  those  conditions,  the  pursuer's  control  must  be 
described  by  Eqs  (46),  while  the  evader's  optimum  control 
must  be  described  by  Eqs  (47). 

It  is  assumed  that  the  initial  states  are  known,  but 
the  end  states  are  not..  Using  the  transversality  conditions 
the  expressions  for  the  costates  at  the  final  time  can  be 
determined  in  terms  of  the  end  states.;  These  are  as  follows 


Axlpf  * 

2<A*lPf  * 

4x,Ef) 

(48a) 

AX2Pf  * 

0 

(4Sb) 

AX3Pf  ” 

2<A*3Pf  * 

Ax3Ef5 

(48c) 

AX4Pf  * 

0 

(48d) 
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A*lEf  '  *2^ixlPf  *  ixlEf^  (<9*) 

AX2Ef  -  0  (49b) 

flXJ£f  *  -2(AxJpf  -  A*3Ef)  (<9c) 

4X4Ef  -  0  (49d) 

As  in  the  non-linear  case,  neither  the  cost,  Eq  (41), 
nor  the  Hamiltonian,  Eq  (42),  is  an  explicit  function  of 
tine.  Thus 


H(t)  «  0  (SO) 

Evaluating  the  Hamiltonian,  Eq  (42),  at  the  final  time, 
utilizing  the  transversality  conditions,  Eqs  (48),  (49)  and 
(40),  yields 


0 


(Axipf  -  Ax1£f)(6x2pf  -  Ax2£f) 


*  W*3Pf  -  **3EfHAX4Pf  -  iXlPf  ■  *X4Ef  *  AxlEf5  (51) 

As  before,  the  stopping  condition  occurs  at  the  poi-, 
of  closest  approach  which  is  found  by  differentiating  the 
range  squared  expression,  Eq  (20),  and  equating  the  result 
to  zero  at  the  f’"al  time.  Again,  the  result  is  identically 
equal  to  Eq  (SI).  Thus,  a  before,  the  stopping  condition 
yields  no  additional  information. 
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Thus,  the  linear,  normalized,  free-time  two  point 
boundary  value  problem  consists  of  the  state  equations, 

Eqs  (39)  and  (40),  the  costatc  equations,  Eqs  (43)  and  (44), 
the  payoff,  Eq  (41),  the  Hamiltonian,  Eq  (42),  the  optimum 
control  angles,  Eqs  (4$)  and  (47),  the  transversal ity  condi¬ 
tions,  Eqs  (48),  (49),  and  (SO),  plus  the  initial  values  of 
the  states. 

Linear  Fixed-time  TPBVP 

The  fixed-time  problem  will  be  identical  to  the  free- 
cine  formulation  just  shown,  with  the  following  exceptions. 

1.  The  value  of  the  Hamiltonian  will  remain  equal 
to  some  unknown  constant,  not  necessarily  zero.  That  is, 
H(T)  •  K. 

2.  The  stopping  condition  will  occur  simply  when  the 
final  time  is  reached.  This  time  will  not  necessarily 
correspond  to  the  point  of  closest  approach.; 

It  is  important  to  note  that  in  either  linear  formula¬ 
tion,  the  evader's  final  costates  are  simply  the  negative  of 
the  pursuer's  final  costates  as  shown  by  the  transversality 
conditions,  Eqs  (48)  and  (49).  This,  coupled  with  the  fact 
that  the  costate  differential  equations  are  identical  for 
both  the  pursuer  and  evader  yield  the  result  that  the  values 
of  the  evader's  costates  are  always  simply  the  negative  of 
the  pursuer's.  That  is,  6X.p  1  -AX^g.  This>  *n  turn, 
precipitates  the  additional  result  that  the  control  angle  is 
identical  for  each  vehicle  since  the  expressions  in  Eqs  (46) 
and  (47)  become  identical. 


31 


GA/MC/72-7 


Linear  Relative  Difference  Tt’BVP 

Because  the  evader  and  pursuer  have  identical  state 
and  costate  equations,  and  because  in  the  linear  formulation 
the  optimum  control  angles  are  identical  for  each  vehicle 
(Op  *  a£).  it  is  pcccible  to  formulate  the  TPBVP  in  a  set  of 
relative  difference  equations.  Define  a  set  of  new  state 
variables  Yi  -  Ax.p  -  Axi£  (i  »  1  ...  4).  The  system  of 
state  equations  now  reduces  to  four  instead  of  the  original 
eight.  Making  use  of  Eqs  (39)  and  (40), 


Likewise 


Y  *  *  Ax  *  -  Ax  * 

1  “*1P  “*1£ 


*  AX2P  *  AX2E 


(S2a) 


Y£  *  2Y^  ♦  Yj  ♦  Au  sir.  a 


(52b) 


Y '  s  Y  -  Y 
*  3  '*  'l 


(52c) 


YJ  *  -  Y?  ♦  Au  cos  a  (S2d ) 

where  now  Au  =  up  -  u^.  This  '  erra  accounts  for  the  difference 
be'.ween  the  vehicles'  masses  and  thrusts. 

Letting  P  signify  the  costates  in  this  formulation,  the 
Haailtonian  now  becomes 
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H  -  PjY2  ♦  P2(2Y4  ♦  Yj  ♦  Au  sin  a)  ♦  Pj(Y4  -  Yj) 


♦  P4(-Y2  *  iu  cos 


(S3) 


Proa  this,  the  costate  differential  equations  becone 


Pi  '  -  P2  *  P3 


(S4a) 


P2  *  *  P1  *  P4 


(54b) 


P3  e  0 


(54c) 


P4  "  *  2P2  *  P3 


(S4d) 


The  value  of  this  optimum  thrust  angle,  a,  can  be  found 
by  nforcing  the  necessary  and  sufficient  conditions  for 
either  the  pursuer  or  evader.; 


3  H 

5a  p  "  P2  Up  cos  a  -  P4  up  sin  o 


and 


32H 

Jo2 
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3H 


*a;_  ’  -  P2  UE  cos  a  +  P4  UE  sin  Q 


and 


32H 


<  0 


The  resulting  expressions  are 


sin  a  * 


CSSa) 


-  P, 


(SSb) 


VP2  *  P4 

The  payoff  in  relative  difference  coordinates  becomes 


2  2 
J  *  vi  *  yj 


(56) 


Again,  the  initial  values  of  the  state  would  be  known, 
but  the  value  at  the  end  condition  would  be  unknown.  Thus, 
the  transversality  conditions  yield  the  following  values  for 
the  costates  at  the  final  condition.; 


Plf  *  2Ylf 


P2f  ’  ° 


(S7a) 

(57b) 


1 
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3f 


2Y 


3f 


(57c) 


P4f  -  0  (57d) 

Note  that  the  costate  differential  equations,  Eqs  (54), 
are  completely  linear.  Those  differential  equations,  with 
the  aid  of  the  boundary  conditions,  Eqs  (S7),  can  be  com¬ 
pletely  solved  in  closed  form.  A  detailed  solution  is 
presented  in  Appendix  A.  The  final  closed  for-  costate 
expressions  are  presented  below  as  a  function  of  the 


characteristic  time,  t, 

V 

and  the  time  at  the 

terminal 

point , 

P1  * 

4Ylf  -  6Y3f(Tf  ‘ 

T)  ♦  4YJf  sin  (Tf  - 

T) 

- 

2Ylf  C0S  '-Tf  ‘ 

(58a) 

P2  ’ 

-4Y3f  *  4Y3f  C0S 

(rf  -  t)  ♦  2YJf  sin 

(Tf  -  T) 

(58b) 

P3  * 

2Y3f 

(58c) 

P4  *  4Ylf  '  6YJf  (Tf  '  T)  '  4Ylf  C0S  f'Tf  *  T) 

i 

♦  8YJf  sin  (Tf  -  T)  (58d) 

j 

J 

Note  that  to  this  point  in  this  formulation,  nothing  has  j 

been  mentioned  concerning  stopping  conditions  since  the  formu-  j 

t 

lation  has  been  independent  of  what  stopping  condition  is  j 
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used.  The  final  tine,  Tf,  nay  be  given  (fixed-tine  problem) 
or  na*'  have  to  be  determined  by  finding  the  point  of  closest 
approach  (free-time  problem).  The  free-time  stopping  condi¬ 
tion  in  relative  difference  coordinates  may  be  obtained  fron 
the  original  linear  stopping  condition,  Eq  (51).  Trans¬ 
forming  coordinates  yields 

0  "  YlfY2f  *  Y3f  CY4f  *  Ylf)  <59> 

Again,  note  that  this  is  the  same  result  one  gets  by 
evaluating  the  right  hand  side  of  the  Kami ltonian, Eq  (S3), 
at  the  final  time. 


o 


I 

I 

f 


o 
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IV.  Validity  of  Linear  Approximations 

Since  the  linearized  equations  are  actually  approxima¬ 
tions  that  assume  the  encounter  occurs  somewhere  near  a  set 
of  reference  conditions,  in  this  case  r^  and  Vg,  the 
equations  will  be  less  valid  the  further  from  these  refer¬ 
ence  conditions  that  the  operation  takes  place.;  That  is, 
errors  due  to  the  linearization  will  occur  whenever  the 
spacecrafts'  altitudes  are  different  from  r^  and  whenever 
their  velocities  are  different  from  VQ.  It  is  desirable  to 
have  some  idea  of  the  errors  that  are  involved.;  In  particu¬ 
lar,  it  should  be  determined  which  parameter,  spacecraft 
altitude  or  velocity,  is  more  critical  in  inducing  these 
errors. 

Comparison  Technique 

To  investigate  this,  a  linear  trajectory  was  compared 
to  several  non-linear  trajectories.  Since  the  costates, 
and  hence  also  the  control,  are  functions  of  the  end  states, 
it  becomes  a  relatively  simple  matter  to  generate  optimum 
trajectories  by  starting  at  some  set  of  final  states  and 
integrating  backward  in  time. 

The  linear  trajectory  is  independent  of  the  specific 
values  of  the  spacecrafts'  altitude  or  velocity  since  the 
linear  equations  (in  relative  difference  coordinates)  deal 
only  with  the  relative  differences  between  the  pursuer's  and 
evadei's  states.  The  non-linear  equations  do  however  depend 
upon  the  exact  values  of  the  spacecrafts'  positions  and 


o 
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velocities.  Thus,  it  was  possible  to  compare  one  linear 
trajectory  with  several  non-linear  trajectories  by  simply 
insuring  that  the  initial  differences  (at  the  final  time  for 
backward  integration)  in  positions  and  velocities  were  the 
same  in  each  non-linear  run.  This  allows  a  determination  of 
the  validity  of  the  linear  approximations  in  various  actual 
non-linear  situations.; 

Standard  End  Conditions 

In  all  open  loop  computer  runs  the  vehicles  were 
assumed  to  end  at  the  point  of  closest  approach  separated 
by  only  a  vertical  distance  (pursuer  above  the  evader).. 

This  corresponds  to  both  and  Y  f  in  Eq  ( S 9 )  equalling 
zito.  That  is,  the  differences  between  the  two  spacecrafts' 
radial  velocities  and  angular  positions  were  tero.  The 
complete  set  of  specific  values  at  the  terrinal  surface  were:. 


YJf  »  0.006 


Y2f  *  ° 


Y3f  *  0 


Y  f  »  0.0252 


These  values  correspond  to  a  terminal  situation  whereby 
the  point  of  closest  approach  occurs  when  the  pursuer  is 
roughly  20  nautical  miles  above  the  evader  and  has  a  trans¬ 
verse  velocity  of  some  6SC  feet  per  second  greater  than  the 
evader.  The  author  does  not  wish  to  imply  that  there  is 
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anything  particularly  significant  about  this  choice  of 
parameters.  It  simply  is  a  reasonable  termi-al  surface. 

Any  set  of  well  behaved  values  could  have  been  used.  Indeed, 
the  author  invites  the  reader  to  pursue  this  subject  with 
another  such  set. 


Non-linear  Cases 

For  the  non-linear  runs,  this  author  chose  to  specify 
the  evader's  exact  final  position  and  velocity  with  the 
pursuer's  being  determined  by  the  differences  given  above; 
i.e.,  approximately  20  NH  higher  and  6S0  fps  faster. 

Six  non-linear  runs  were  made  as  shown  in  Table  I,  The 
first  cf  these  selected  the  evader’s  final  orbit  to  be 
exactly  that  orbit  used  as  a  reference;  i.e.,  a  circular 
orbit  at  the  earth's  surface.  This  case  (Run  ))  was  to  be 
considered  the  "best"  non-linear  situation  for  the  linear 
approximations 

The  next  case  (Run  2)  raised  the  evader's  final  altitude 
by  200  NH,  to  3644  NM-.  but  left  its  final  velocity  equal  to 
that  of  the  reference  orbit  (4.269  h'M/sec)  .  This  means  that 
at  the  final  time,  the  evader  was  arriving  at  the  perigee  of 
its  orbit.-  This  altitude  increase  corresponds  to  a  5.8'i 
increase  above  the  reference  orbit. 

The  remaining  cases  dealt  with  changing  the  terminal 
velocity  of  the  evader.  Runs  3  and  4  decreased  the  evader's 
terminal  velocity  by  S .  8T  of  the  reference  orbit’s  velocity.; 
Run  3  assumed  the  evader  ended  at  the  reference  altitude 
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Table  I 


Evader  Non-linear  End  Conditions 


Altitude 

NM 

Transverse  Velocity 
NM/second 

Run 

3444 

(Ref) 

3644 

4.021 

4.269 

(Ref) 

4.517 

1 

X 

X 

2 

X 

X 

3 

X 

X 

4 

X 

X 

5 

X 

X 

6 

X 

X 

'3444  NH)  while  Run  4  assumed  it  ended  at  the  higher  alti¬ 
tude  (3644  NM), 

Runs  5  and  6  increased  the  evader's  terminal  velocity 
by  the  same  5.8%  of  the  reference  orbit's  velocity.  Run  5 
ended  at  3444  NH,  while  Run  6  ended  at  3644  NM  altitude. 
Appendix  B  contains  t> e  actual  trajectories  generated  by 
these  six  non-linear  runs.-  Also  presented  in  Appendix  B 
are  the  plots  of  separation  distance  as  a  function  of  time 
for  each  of  the  six  runs. 

Results 

Figures  4  through  7  show  relative  differences  (unitless 
Y  coordinates)  of  these  six  runs  as  a  function  of  time.-  Also 
shown  on  each  figure  is  the  curve  obtained  from  the 
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Fig.  S.  Conparison  of  Six  Non-lincar  Optimum  Trajectorie 
tc  the  Linear  Optinvm  Trajectory  in  the  Relative 
Difference  Coordinate.- 
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linearized  equations,  although  that  curve  is  often  indis¬ 
tinguishable  from  Run  1  (best  case). 

The  time  to  go  in  the  Y  trajectory  figures  is  the 
characteristic  time  difference  T ^  -  t.  Thus,  a  time  to  go 
of  -1.00  corresponds  to  about  806  seconds  before  the  final 
time. 

Note  that  in  all  cases  except  Yj  (which  relates  the 
vehicles'  angular  position),  the  runs  eventually  tend  towards 
groups  based  upon  like  altitude.  Thus,  Runs  1,  3  and  5  tend 
as  a  group  to  separate  from  the  group  composed  of  Runs  2,  4 
and  6.  Nithin  each  of  the  groups,  the  different  velocities 
show  their  effect. 

The  exception  is  in  Y^,  Figure  6,  where  velocity  appears 
to  be  the  key  element.  Here,  the  six  runs  are  clustered  in 
pairs,  each  pair  representing  one  velocity.  The  different 
altitude*  are  hardly  noticeable  in  each  pair.  In  fact, 
although  more  noticeable,  even  the  different  velocities 
present  only  minor  errors  from  the  linear  case.-  Indeed,  it 
will  be  shown  later  that  nearly  all  fixed-time  TPBVP  solutions 
provide  excellent  agreement  in  the  Y^  parameter. 

In  all  cases,  the  velocity  increase  has  an  apposite 
(but  like  magnitude)  effect  from  a  velocity  decrease.-  It 
also  can  be  seen  that  a  velocity  decrease  (Run  3)  from  the 
reference  velocity  causes  the  Y  parameters  to  be  offset  from 
the  linear,  or  Run  1,  cases  in  the  same  direction  as  the  alti¬ 
tude  increase.  Run  2.  Thus  the  greatest  errors  in  the  Y 
states  are  caused  by  the  combination  of  both  a  velocity 
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decrease  and  altitude  increase.  Run  4. 

On  the  other  hand,  an  altitude  greater  than  the 
reference  orbit  (which  all  real  world  orbits  must  be) 
induces  Y  state  errors  which  tend  to  be  offset  by  a  vehicle 
transverse  velocity  greater  than  the  reference  velocity.  The 
aacunt  of  velocity  increase  needed  to  eliminate  Che  altitude 
induced  error  varies  for  each  Y  state.  For  instance,  for 
tine  within  about  0.7S  characteristic  units  of  x-,  Y, 

I  4 

requires  only  about  a  one  to  one  percentage  difference. 

Thus  for  Y^ ,  Run  6  which  has  a  S.8V  altitude  increase  and  a 
5.81  velocity  increase  provides  an  excellent  correspondence 
to  the  linear  and  base  (Run  1)  cases.  Y^,  as  the  opposite 
extreme,  would  require  considerable  more  velocity  increase, 
particularly  as  tine  becomes  further  from  x^.  As  time 
becomes  close  to  x^,  all  errors  become  quite  small.* 

Conclusions 

Thus,  one  sees  that  the  linearized  equations  are 
excellent  approximations  to  all  the  six  runs  at  times  very 
close  to  the  final  time.  Also,  the  linearized  equations  are 
an  excellent  approximation  to  the  non-linear  situation  at 
the  reference  orbit  (Run  1).  Since,  for  the  most  part,  errors 
from  increased  altitude  tend  to  be  offset  by  increased 
velocity,  the  linearized  equations  would  tend  to  be  most 
accurate  near  the  perigees  of  higher  altitude  elliptical 
orbits  rather  than  near  their  apogees.  The  accuracy  would 
also  decrease  for  higher  altitude  circular  orbits.-  The 
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aaount  of  eccentricity  in  the  elliptical  orbit  to  completely 
eliminate  the  increased  altitude  induced  errors  would  vary 
for  each  Y  state  and  would  also  vary  as  a  function  of  the 
tiao  to  go. 
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V.  Solutions  to  the  TPBVP's 


Fixed-time  TPBVP 

Chapter  IV  presented  six  numerical  njn-linear  trajec¬ 
tories  and  compared  then  with  respect  to  the  terminal  states, 
against  the  linear  trajectory.  Thos  trajectories  were 
obtained  by  backward  integration  of  the  equations  of  motion.; 
This  chapter  will  present  the  linear  solutions  to  the  fixed- 
tir.e  TPBVP's  obtained  by  using  as  initial  conditions  selected 
points  from  each  of  the  six  trajectories  discussed  in  Chapter 
IV.  The  linear  solutions  developed  use  the  analytical 
formulation  of  the  fixed- time  TPBVP  for  relative  difference 
coordinates  that  was  presente  in  Chapter  III. 

Kaving  the  backward  generated,  optimum,  non-linear  solu¬ 
tions  for  six  runs;  it  was  desired  to  see  how  closely  the 
linearized  solutions  to  the  TPBVP  would  approximate  these 
six  cases.  Thus,  three  points  were  chosen  from  each  non¬ 
linear  run.  The  points  selected  were  ac  approximately  0.25, 
0.5  and  1.0  characteristic  time  units  from  the  terminal 
surface.  The  set  of  values  of  the  relative  difference 
states  at  each  of  these  points  was  used  as  initial  conditions 
and  input  to  the  fixed-time  TPBVP  solver.  The  program 
iterated  on  a  set  of  assumed  end  conditions  until  it  con¬ 
verged  to  the  initial  conditions.  The  linear  solutions 
generated  from  each  of  these  points  is  displayed  in  Figs.  8 
through  13.- 

As  would  be  expected,  the  errors  induced  from  the 
linearized  solution  increase  with  time.  That  is,  even 
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Fig.  11.  Trajectories  Generated  from  Solutions  to  the  Fixed 
tine  TTBVP  Compared  to  the  Run  4  Son-linear  Optimum 
Trajectory  in  Relative  Difference  Coordinates.. 
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Fig.  12.  Trajectories  Generated  from  Solutions  to  the  Fixed 
time  TPBVP  Compared  to  the  Hun  $  Non-linear  Optinum 
Trajectory  in  Relative  Difference  Coordinates. 


Fi£.-  13.  Trajectories  Generated  from  Solutions  to  the  Fixed- 
tine  TPB\T  Compared  to  tl. t  Run  6  '.on- linear  Optimum 
Trajectorv  in  Relative  Difference  Coordinates. 
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tnough  the  linearized  solution  starts  at  the  sane  point  as 
the  non-linear  solution,  the  paths  tend  to  diverge  with 
tine.  Thus  for  the  most  part,  the  closer  the  input  data  is 
to  zero  time  to  go  the  more  accurate  will  be  the  fixed  time 
solution  generated  from  that  point. 

Host  noticeable  is  the  effect  of  the  different  base 
altitudes  (final  evader  altitude).  Runs  1.  1  and  S  assume  a 
final  evader  altitude  of  3444  NM.  Runs  2,  4  and  6  assume  a 
final  evader  altitude  of  3644  NM.  Three  things  are  readily 
noticeable.  First,  each  run  in  each  set  appears  almost 
identical  to  the  other  runs  in  that  set.  That  is,  the 
results  of  Run  1  appear  almost  identical  to  the  resplts  of 
Run  S.  likewise  for  the  other  set.  Runs  2,  4  and  6. 
Secondly,  those  runs  at  the  higher  base  altitude  (Runs  2,  4 
and  6)  exhibit  substantially  greater  errors  than  do  those 
runs  at  the  lower  altitude  (Runs  1,  3  and  5).;  Thirdly,  the 
effects  of  the  different  base  velocities  are  practically 
indistinguishable. 

Thus,  for  the  fixed-time  solutions,  the  actual  base 
altitude  is  the  mo't  important  consideration.  At  this  point 
it  becomes  apparent  that  the  further  from  the  linearized 
reference  altitude  one  gets,  the  less  accurate  will  be  his 
fixed  time  solution,  here,  there  appears  to  be  no  such 
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thing  as  velocity  compensation  for  altitude  errors  as  there 
was  in  Chapter  IV.  Based  on  the  fixed-time  results,  it 
appears  most  important  to  linearize  the  equations  of  notion 
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about  an  orbit  whose  altitude  ' s  as  close  to  the  actual 
altitude  of  operation  as  possible. 

Eree-tiiae  TP8VP 

It  was  attempted  to  generate  free-time  solutions  from 
each  of  the  sane  points  where  fixed-time  solutions  were 
generated  in  the  previous  chapter.;  The  free-time  problem 
did  not,  of  course,  specify  for  what  time  the  input  data 
corresponded.  Instead,  the  free-time  solver  selected  the 
time  by  driving  the  final  range  squared  rate  expression  to 
zero  (within  some  limits). 

The  method  used,  as  discussed  before,  was  actually  to 
solve  several  fixed  time  problems,  forcing  the  final  range 
squared  rate  toward  zero  by  use  of  a  Newtor.-Raphson  technique. 
To  solve  a  fixed  time  problem  requires  an  estimate  of  the  final 
time.  It  was  found  that  the  value  of  this  initial  estimate 
could  be  rather  arbitrary  since  the  program  would  iterate  to 
within  an  order  of  magnitude  of  the  correct  value  within  a 
very  few  cycles.  However,  it  was  found  that  the  use  of  a 
smaller  initial  estimate  of  time  to  go  greatly  decreased  the 
overall  convergence  time  since  the  time  to  perform  each  cycle 
or  iteration  i;  directly  related  to  the  estimate  of  time 
to  go. 

One  immedia  e  result  of  experimentation  was  that  it  was 
extremely  difficult  to  generate  free-tiac  solutions  for  those 
data  inputs  close  to  zero  time  to  go.  That  is,  of  the  input 
data  from  0.25,  0.5  and  1.0  characteristic  time  uni's,  only 
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the  data  from  1.0  consistently  yielded  any  results.  Those 
results  are  displayed  in  Figs.  14  through  19.  The  shorter 
time  problems  (0.S  and  particularly  0.25)  required  either 
very  accurate  initial  estimates,  or  very  loose  convergence 
tolerances  and  lengthy  convergence  (i.e.,  computer)  time. 
Since  it  was  desired  to  obtain  solutions  that  did  not  require 
extremely  accurate  initial  estimates  and  since  the  lengthy 
time  required  for  solution  of  the  short  time  to  go  problems 
was  greater  than  the  time  to  go,  These  particular  situations 
were  not  investigated  in  great  detail.  Instead,  the  con¬ 
clusion  is  made  that  the  initial  free-time  solution  must  be 
generated  when  the  time  to  go  is  still  reasonably  large. 

This  initial  free-time  solution  could  then  be  updated  and 
improved  upon. 

Analysis  of  the  free-time  solutions  shown  in  Figs.  14 
through  19  yields  a  conclusion  similar  to  that  for  The  fixed¬ 
time  solutions.  Again,  the  six  runs  are  divisible  into  two 
distinct  sets.  Each  set  represents  a  different  final  alti¬ 
tude..  That  is.  Runs  1,  3  and  5  all  resemble  each  other  and 
Runs  2,  4  and  6  also  resemble  each  other.-  Use,  as  in  iho 
previous  chapter,  the  higher  altitude  runs  (Runs  2,  4  and  6) 
induce  greatei  errors  than  do  the  runs  at  the  lower  altitude. 
To  yield  higher  altitude  runs  with  smaller  errors  would 
require  the  convergence  tolerances  to  be  made  smaller.  This, 
of  course,  would  increase  the  time  for  convergcnc*.  The 
convergence  tire  for  those  cases  m  this  study  va-i vd  from 
IS*  to  25 •  of  the  time  to  go.  Further  increases  in  this 
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1.00  -0.60  -0-20 

TIME  TO  GO 


Fij>.  17.  Trajectory  Conerated  fror>  Solution  to  the  Frcc- 
tii/it  TPB'T  Compared  to  the  Kun  4  .'.on- linear  Ontinun 
Trajectory  m  Itclativc  Difference  Coordinates. 
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Fig.  18.:  Trajectory  Generated  fron  Solution  to  the  Free 
tine  TPBVP  Conpercii  to  the  Run  5  Non- linear  Optir.un 
Trajectory  in  Relative  difference  Coordinator 
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convergence  tine  would  decrease  the  worth  of  the  solutions. 

Again,  the  differences  induced  by  the  velocity  varia¬ 
tions  are  indistinguishable.  Thus,  the  same  conclusion  is 
reached.  The  major  sources  of  e-ror  is  due  to  operating  at 
an  altitude  other  than  the  linear  reference  orbit.  This 
error  may  be  at  least  partially  diminished  by  reducing  the 
allowable  convergence  tolerances,  but  this  increases  the 
required  time  for  convergence. 

Some  additional  computational  details  are  given  in 
Appendix  C.- 
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VI.  Pseudo  Closed  Loop  Control  Law 


A  closed  loop  control  law  would  be  desirable  in  any  real 
tine  encounter.  That  is,  you  as  a  player  would  like  to  be 
able  to  take  advantage  of  any  non-optimal  play  by  your 
opponent,  thus  bettering  your  final  payoff  over  that  which 
would  develop  had  you  not  taken  advantage  of  your  opponent's 


Normally,  closed  loop  solutions  can  be  generated  for 
linear-quadratic  problemr..  Since  the  situation  treated  in 
this  thesis  is  pseudo  linear,  linear  in  state  but  non-linear 
in  control,  it  was  attempted  to  develop  (or  rather  approach) 
a  closed  loop  solution  as  closely  as  possible.-  This  chapter 
discusses  the  development  of  that  pseudo  closed  loop  control 


Matrix  Formulation 

The  relative  difference  state  equations,  Eqs  (S2),  can 
be  written  in  the  following  -■atrix  form: 


[*’]  *  [F}[Y]  *  [G] 


0  1 


10  0  2 


-10  0  1 


0-1  0  0  J 


<  a 
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Au  sin  a 


Au  cos  aj 


From  the  F  matrix,  one  can  find  the  fundamental  or 
transition  matrix,  *(Tf<To)«  for  this  system  of  equations. 
Appendix  £  contains  that  *  derivation. 

Having  the  tiansition  matrix,  the  end  states,  Yf,  can 
be  written  in  terms  of  the  present  measurable  states  Y^: 

[Yf]  »  [*(Tf,T0)][Y0}  *  /’*  [*(Tf,t)J[G(t)]dT  (63) 


w'lere  G(x)  contains  the  control  parameters  as  a  function  of 
characteristic  time  tau  and  the  end  states.  Thus  if  the 
control  matrix  were  zero,  the  problem  would  degenerate  into 
a  strictly  linear  problem  and  the  final  states  could 
immediately  be  found  by  using  the  transition  matrix  to 
operate  on  the  initial  states.  In  fact,  a  very  rough  first 
approximation  of  the  final  states  could  be  made  in  just  that 
way,  i.e.,  assuming  no  control.  This  rough  approximation  of 
the  final  states  could  then  be  used  to  provide  the  control 
inputs.-  This  technique  would  be  one  of  the  easiest  to 
implement,  however,  it  would  have  tc  be  updated  at  verv 
short  time  increments  due  to  the  erroneous  assumption  of 
zero  thrust..  Also,  this  would  not  be  a  closed  loop  control,- 
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Development 

A  theoretically  more  accurate,  although  more  complex 
solution  can  be  generated  by  first  solving  the  free-timt 
TPBVP  thus  getting  initial  estimates  of  and  t^.-  These 
estimates  can  then  be  used  in  the  control  angle  expressions. 
Having  a  control  program  it  can  simultaneously  be  used  to 
numerically  integrate  the  equations  of  motion  forward 
(assuming  both  player*,  play  optimally)  and  to  fly  the  actual 
trajectory.  At  periodic  intervals,  direct  measurements  of 
the  opponent's  actual  state  can  be  made.  These  measurements 
can  be  compared  with  the  numerically  integrated  values.  The 
differences  can  be  used  to  update  the  control  program  through 
the  use  of  »he  differential  of  Eq  (63).  That  differential 
must  allow  for  changes  in  both  the  final  states  and  final 
time.  Thus, 

[AYffJ  .  [*(Tf,T0)](4Y0]  ♦  {[♦(Tf.T0)][Y0]>ATf 

♦  j7~  {St  [«(T  ,T)HG(T))dT)6Tf 
f  *0 

.  T  . 

+  VT  {/t'  mTf,T)J[G(T))dT}[AYf]  (64) 

f  *  G  1  1 

where  AY^  is  the  difference  between  the  values  of  the  present 
state  as  measured  and  as  calculated  from  the  free-time  TPBVP, 
AYjj.  is  the  amount  that  must  be  sdded  to  the  present  esti-ate 
of  Y^.  and  Atj,  is  the  amount  that  must  be  added  to  the  present 
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estimate  of  (which  too  was  determined  from  the  solution 
to  the  TPBVP) .  AYf  is  the  difference  between  the  corrected 
Yj  at  Tj  and  the  original  value  of  Y^  as  is  seen  in  Fig.  20. 
These  parameters  are  related  in  tne  following  way: 


AYff  =  AYf  ♦  Y£Atf 


or 


AYf  «  AYff  -  Y£Atf 


(65) 


o 


Equation  (6S)  can  be  used  to  replace  AY^  in  Eq  (64). 

The  result  would  be  an  expression  in  terms  of  the  initial 
known  quantities  (YQ  and  AYQ)  and  the  two  unknowns  AYff  and 
Art>.  Another  equation  is  needed  to  facilitate  determination 
of  these  unknowns.  That  other  equation  can  be  formed  from 
the  Hamiltonian  which  must  remain  equal  to  zero  at  the  "new" 
final  time  *  Arf.  Thus  AHf  <=  0.  Expanding, 


if;  4Yf  ♦  %  -f  *  0 


3  H 

But  since  from  Eq  (59),  =  0,  the  above  equation  becomes: 


BH  a  v  n 

tT{  4Yf  ’  0 


(66) 


o 


Substituting  Eq  (65)  into  Eq  (66)  results  in  the  second 
equation  in  terms  of  AY^  and  At^: 


$7  t4Yff  -  Yf4V  * 0 


(67) 
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Fig.  20.  Relationship  Between  Differences  in  Y  State 
at  the  Original  final  Time  Tf  and  at  the  Corrected 


Final  Time  ^  ♦  Atf. 


Now,  the  combination  of  Eqs  (64)  and  (6S)  can  tc  solved 
for  in  terms  of  A T^.  Those  expressions  can  then  be 


used  in  Lq  (67)  to  provide  a  scalar  equation  relating  At^.  to 


the  known  initial  states.;  Solving,  the  value  for  At,  can 
then  be  used  to  provide  AY^,  the  quantity  which  must  be 
added  to  the  original  Y^.  estimate. 

These  solutions,  tnen,  arc  the  corrections  that  must  be 
applied  to  the  original  estimate  of  the  final  states  and 
final  time.  Thcsa  new  estimates  can  then  be  used  to  update 
the  values  of  the  control  variables.  The  updated  controls 
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c»n  then  be  used  until  another  update  is  desired.  This  next 
update  could  be  required  after  some  finite  anount  of  tine 
had  passed  or  after  the  errors  between  the  measured  and 
calculated  trajectories  (AYg),  due  to  the  opponent's  non- 
optinal  play,  exceed  some  specified  tolerance.  At  that 
point,  Eqs  (64),  (65)  and  (67)  can  then  again  be  solved  to 
provide  another  control  update.. 

This  technique,  of  using  Eqs  (64),  (6S)  and  (67)  to 
update  the  control  by  a  function  of  the  present  measured 
state,  is  the  pseudo  closed  loop  control  law  that  this 
chapter  set  out  to  derive.; 

Numerical  Test 

This  technique  was  tested  numerically  against  two  non- 
optimum  evaders.  The  basic  situation  was  that  of  Sun  4, 
described  earlier  in  this  report.  In  the  first  case,  the 
evader's  thrust  angle  was  held  constant  at  180'  and  in  the 
second  case,  it  was  neld  constant  at  a  value  of  0*.  In  both 
cases  it  was  assumed  that  the  exact  solution  to  the  TPBVP  was 
known.  This  of  course  could  not  be  true  in  an  actual  opera¬ 
tion,  but  served  as  a  test  case  for  this  analytical  investi¬ 
gation.  The  exact  solution  yields  the  final  states  that 
would  exis"  if  both  vehicles  had  been  playing  optimally. 

For  comparison  purposes,  each  non-optimum  rvader  also 
was  "flown"  against  a  pursuer  who  followed  his  open  loop 
control.  The  minimum  separation  distances  for  these  various 
tiajectories  arc  tabulated  in  Table  H,. 
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Minimum  Separation  Distances  (NM) 


Case 

Open  Loop 

Pseudo  Closed  Loop 

1. 

Both  Optimum 

20.6 

2. 

Evader  Thrust 
at  180* 

13.4 

13.1 

3. 

Evader  Thrust 

at  0* 

13.7 

44.9 

o 


o 


Since  in  the  non-optimum  cases  it  is  the  evader  who  is 
playing  non-opt  imr.l  ly ,  the  final  separation  distance  should 
be  less  than  when  both  vehicles  are  playing  optimally.  In 
addition,  the  pseudo  closed  loop  technique  should  further 
decrease  that  final  separation  distance. 

Based  on  these  premises.  Table  11  appears  to  be  plagued 
with  a  large  inconsistency  in  that  the  correction  technique 
applied  agaii.  .t  the  0*  thrust  angle  evader  increases  the 
final  separation  distance  over  the  open  loop  run! 

Although  that  increase  is  discouraging,  deeper  analysis 
of  the  resulting  numerical  test  indicates  the  situation  may 
not  be  as  bad  as  it  appears.  That  is.  the  corrections  At^ 
and  ATjj.  that  were  calculated  in  the  course  of  the  test  were 
in  the  correct  direction.  The  magnitude  of  the  AY.,  correc¬ 
tion,  though,  were  ioo  great  too  soon..  The  magnitude  of 
these  corrections  being  too  large  caused  the  pursuer  to  over 
correct  his  control  program..  This  over  correction  resulted 
in  the  pursuer  being  tahen  off  his  optimum  trajectory.-  By 
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the  tine  the  control  law  realized  it  had  over  corrected,  and 
started  to  reconpensate ,  the  scenario  had  reached  the  termi- 
nal  surface  (the  point  of  closest  approach).; 

It  should  be  noted  that  the  updating  by  the  control 
system  was  performed  at  a  set  periodic  interval  of  about 
every  hundred  seconds.  The  entire  open  loop  game  lasted  some 
800  seconds  while  the  closed  loop  game  terminated  after  only 
570  seconds.  Thus,  in  the  latter  case,  only  five  updates 
were  made  during  the  entire  game.  Since  the  errors  AYq's 
grow  between  updates,  those  errors  may  have  grown  so  large 
as  to  invalidate  the  linearization.  To  check  tha*  possibility, 
one  additional  test  was  run  against  the  0°  evader  with  an  up* 
date  interval  half  as  long  (i.e.,  about  50  seconds).;  The 
final  separation  distance  from  that  run  was  only  34.6  NM,  a 
marked  improvement.  Thus  it  is  felt  that  the  use  of  a  shorter 
interval  between  updates  would  keep  the  AY^  errors  smaller 
and  thus  diminish  the  over  correction  of  the  control.-  This 
in  turn  would  improve  tne  final  separation  distance. 

Another  possible  explanation,  more  basic  in  nature,  for 
the  increased  final  separation  distance  is  that  the  situation 
investigated  in  this  entire  thesis  may  just  not  lend  itself 
to  this  particular  quantitative  analysis.  That  is,  the 
assumed  low  thrusts  and  large  mass  (made  so  to  allow  the 
original  constant  mass  assumption)  coupled  with  the  rather 
large  value  of  final  relative  velocity  between  the  spacecraft 
may  simply  not  allow  any  greit  degree  of  control. - 
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To  justify  keeping  the  masses  constant,  the  thrust  of 
the  pursuer  had  been  set  at  S00  lb.  and  the  weight  of  the 
spacecraft  had  been  set  at  in, 000  It.  The  final  transverse 
velocity  difference  between  the  spacecraft  was  set  at  about 
650  feet  per  second,  to  insure  the  two  vehicles  vould  "pass" 
each  other.  Observing  that  the  vehicles  had  been  thrusting 
in  the  third  quadrant  (with  the  evader  leading  the  pursuer) 
for  some  800  seconds  before  the  final  conditions  occur,  it 
can  be  shown  that  at  the  initiation  of  the  encounter  the 
relative  closing  rate  would  be  650  fps  plus  an  additional 
value  of  up  to  1600  fps.  Thus,  the  initial  closing  velocity 
between  these  two  spacecraft  is  in  the  neighborhood  of 
1S00  fps. 

Thus,  with  an  initial  closing  rate  of  that  high,  it 
appears  that  the  small  thrust  to  weight  ratios  may  simply  be 
too  small  to  have  much  pronounced  effect  upon  tl.e  final 
separation  distance. 

Hence,  the  results  of  this  numerical  test  of  the  pseudo 
closed  loop  control  technique  are,  unfortunately,  inconclu¬ 
sive,.  However,  it  is  recommended  thst  future  cffoit  in  this 
particular  area  use  shorter  update  intervals  and  l.rger 
thrust  to  weight  ratios,  even  at  the  expense  of  thr  constant 
mass  assumption.. 


UMMiai 


o 


o 


o 


o 


VII.  Conclusions  and  Recommendations 

Conclusions 

A  two-dimensional  pur  suit -evas ion  encounter  between 
two  constant  thrust  spacecraft  in  near-earth  orbit  has  been 
formulated  at  a  differential  game  with  control  being  provided 
by  the  thrust  angle.  The  spacecraft  were  given  a  high 
closing  velocity  to  insure  the  game  would  go  to  completion.. 
The  thrust  to  weight  ratios  were  kept  low  in  order  to  assume 
constant  mass  vehicles.:  The  en-ounter  took  place  m  an 
inverse  square  gravity  field  near  the  earth's  surface. 

The  non-linear  equations  of  notion  were  linearized  about 
a  circular  reference  orbit  at  the  earth's  surface.-  Open  loop 
solutions  were  generated  for  both  sets  of  equations  backward 
in  tine  from  selected  terminal  states.  The  linear  open  loop 
solution  compaied  quite  favorably  with  the  non-linear  solu¬ 
tions  for  both  vehicles  playing  optimally.  Operation  at 
altitudes  above  the  reference  orbit  induced  errors,  but  these 
were  partially  offset  by  allowing  the  velocities  to  be 
greater  than  the  reference  orbit. 

The  linearization  of  the  equations  of  notion  provided 
for  clo'-ed  fora  solutions  to  the  costate  vector.-  This,  in 
cum,  al ’owed  the  control  (thrust  angle)  expressions  to  be 
simplified. 

Using  the  simplified,  or  approximate,  control  expres¬ 
sions,;  both  the-  f.ted-iine  and  frce-tine  two  point  boundary 
value  proa i -  wc-e  so.ved.  As  was  expected,  the  errors  in 
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these  linearized  solutions  diverge  from  the  actual  trajectory 
as  time  passes.  In  addition,  off  reference  altitudes  were 
again  found  to  be  the  greatest  contributor  of  errors,  only 
now  the  errors  did  not  see®  to  be  decreased  appreciably  by 
any  compensating  velocity  errors. 

It  was  found  that  fairl;  accurate  free-time  solutions 
could  be  generated  (within  acceptable  computer  tine  limits 
also)  by  requiring  only  moderate  convergence  accuracies. 

As  the  terminal  surface  was  approached,  it  became 
increasingly  more  difficult  to  obtain  a  free-time  solution. 
Thus,  in  an  actual  encounter,  the  initial  free-time  solution 
should  be  generated  when  the  time  tt  go  is  stiil  reasonably 
large.  This  initial  free-time  solution  could  then  be 
updated  and  improved.' 

A  pseudo  Closed  loop  control  technique  was  developed 
based  upon  the  fundamental  or  transition  matrix  of  the 
linearized  equations  of  notion..  However,  its  effects  upon 
the  particular  encounter  tested  were  inconclusive,  probably 
due  to  the  inherent  sensitivities  of  the  problem.  That  is,, 
the  assumed  low  thrust  to  weight  ratios  coupled  with  the  high 
closing  velocities  appear  to  dimmish  the  effectiveness  of 
the  control. 


Recommendations 

Investigation  of  this  problem  has  '  cd  this  author  to 
thiee  main  recommendations  for  further  study. 

First,  since  altitude  is  the  greatest  contributor  to 
cirors  in  the  linearized  solutions,  it  would  be  fruitful  to 
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linearize  the  equations  of  notion  about  an  orbit  which  nore 
nearly  approximates  the  altitude  of  operation.  Once  that  is 
done,  then  the  results  can  be  compared  with  the  non-linear 
solutions.  This  should  improve  the  overall  accuracies. 

Second,  attempt  to  test  a  control  program  based  strictly 
upon  the  transition  matrix.  Thus,  the  present  measured 
states  could  very  quickly  be  transformed  to  end  states,  and 
the  exact  tr-.nsforraation  selected  would  be  the  one  which  gave 
the  correct  terminal  surface,  i.e.,  minimum  separation 
distance.  This  method  would  be  inherently  erroneous  as  the 
application  of  the  transition  matrix  requires  the  assumption 
that  no  control  is  to  be  provided..  However,  since  the 
process  vould  be  so  rapid,  it  could  easily  be  updated 
(repeated}  almost  instantaneously  and  night  allow  for  a  very 
easy  control  system.  The  purpose  of  the  test  would  be  to 
check  the  accuracy  of  the  technique.- 

Lastly,  since  this  author  encountered  apparent  sensi¬ 
tivity  problems  with  this  low  thrust  to  weight,  high  closing 
velocity  scenario,  it  is  recoanendcd  that  future  investiga¬ 
tors  assume  larger  thrust  to  weight  ratios,  even  at  the 
expense  of  tile,  constant  mass  assumption. 
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Appendix  A 

Closed  Form  Costate  Solution 

The  linear  relative  diffeience  costate  differential 
equations,  Eqs  (54),  can  be  solved  in  closed  form,  with 
the  aid  of  the  costate  end  conditions,  Eqs  (57),  to  yield 
expressions  for  the  costate  vector.  The  differential 
equations  are  repeated  below:; 


1 


-P2  *  P3 


(S4a) 


pa  *  'pi  *  p4 


(54b) 


o 


p.  ,  n 


(54c) 


P-  -  -2P,  -  P3 


(54d) 


The  end  conditions  have  been  given  as: 


Plf  '  2Ylf 


(S7a) 


P2f  *  0 


(57b) 


P3f  *  2Y3f 


(57c) 


P4f  *  ° 


(57d) 


o 


It  cm  readily  be  seen  that  P,  is  a  constant. 
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P3(X)  *  2YJf  (A_1) 

Using  Cramer's  rule  on  the  remaining  three  equations 
and  letting  D  indicate  differentiation  with  respect  to  t 
yields : 


D  1  0 

P3  1  0 

1  D  -1 

P1  * 

0  D  -1 

0  2  D 

-P3  2  D 

(D3  ♦  D)Pj  »  3P j  (A-2) 

The  root:  of  the  characteristic  equation  of  the  system 
are  0,  +  i.  The  complementary  solution  is  therefore 

Cj  ♦  C2  sin  t  ♦  Cj  cos  T 

Now,  the  forcing  function  is  simply  a  constant.  Since 
there  is  already  a  constant  term  in  the  cosiolementary  func¬ 
tion,  one  must  assume  a  particular  integral  of  the  form 
£  *  Kt  .  Putting  this  assumed  solution  into  the  differential 
equation  Eq  (A-2)  gives 


Thus, 


0  ♦  K  ■  3Pj 


Pj  «  Cj  ♦  3PjT  *  C2  sin  T  ♦  C,  cos  T 


/5 


(A-3) 
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Likewise , 


which  yields 


(D  ♦  D)P2  *  0 


P,  «  C.  ♦  C,  sin  t  ♦  C,  cos  t 
i  4  5  O 


(D  ♦  D)P, 


*  2P3  *  P3 


Again,  one  must  test  a  particular  integral  of  the  form 
P  «  Kt  and  find  that  K  -  3Pj.  Thus, 


P^  «  C7  ♦  3PjT  ♦  Cg  sin  T  *  Cj  cos  T 


These  three  equations  for  Pj,  P^  and  P ^  may  now  be 
substituted  into  the  original  costate  differential  equations 
to  obtain  relationships  among  the  nine  constants 
Cj,  Cj,  ...  Cg.,  Differentiating  Eq  ( A  -  2 ) 


Pj  *  3Pj  ♦  C2  cos  T  -  Cj  sin  T 
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It  is  now  possible  to  write  the  costate  equations  in 
terns  of  only  three  unknown  constants: 


P1  *  C1  *  IP3t  *  C2  Sin  T  +  C3  cos  T  (A- 10) 


p2  *  -2Pj  -  C2  cos  T  ♦  C3  sin  x  (A- 11) 


P4  *  Cj  ♦  3P3t  ♦  2C2  sin  x  ♦  2Cj  cos  x  (A-12) 


One  can  now  use  the  transversality  conditions,  Eqs  (S7), 
to  solve  for  the  three  constants.  Equating  the  transversality 
conditions  to  Eqs  (A-10),  CA- 11)  and  (A-12)  at  x  ■  x{  gives 


2Ylf  *  Cl  +  3P3Tf  *  C2  Sin  Tf  +  C3  cos  Tf 


0  «  - 2P j  -  Cj,  cos  xf  ♦  C3  sin  xf 


0  *  Cj  ♦  3P jX £  ♦  2C2  sin  xf  ♦  2Cj  cos  xf 


Subtract  Eq  (A-1S)  from  twice  Eq  (A- 13)  to  yield 


4Ylf  "  C1  *  3P3Tf 


C1  *  4Ylf  -  3Vf 


Substitute  Eq  (A-16)  into  Eq  (A-1S): 


(A- 13) 


(A- 14) 


(A- 15) 


(A-16) 
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0  ■  4Ylf  -  3PjTf  ♦  JPjYj  ♦  2C j  sin  Tf  ♦  2Cj  cos  Tf 


2Yjf  ♦  C2  sin  Tf  ♦  C j  cos  Tf 


(A- 17) 


Solving  Eq  (A- 14)  for  C, 


2P 

zstt:  ♦  cs  *«  Tf 


(A-18) 


Substitute  Eq  (A-18)  into  Eq  (A- 17)  to  get 


C.  sin  r, 

0  ■  2Y.,  -  2P  tan  T,  ♦  — - -  *  C.  cos  t. 

If  3  f  cos  T.  3  t 


o 


Multiplying  each  tern  by  cos  Tf, 


0  «  2YJf  cos  *  2pj  si"  ♦  C3 


Thus , 


Cj  *  2Pj  sin  Tf  -  2Y j j  cos  tf 


(A-19) 


Substitute  Eq  (A-19)  into  Eq  (A-18): 


2P- 


sin2  t, 

*  2P3  -  2Yif sin  Tf 


-  2Pj  cos  Tf  -  2Yjf  sin  Tf 


(A- 20) 


o 


One  can  now  use  the  values  of  these  constants  to  form 
the  following  closed  form  expressions  for  the  costates: 
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o 


Pj  ■  4Ylf  ♦  3Pj(t-t£)  -  2P j  cos  Tf  sin  T  -  2YJf  sin  Tf  sin  T 

♦  2Pj  sin  t£  cos  t  -  2YJf  cos  rf  cos  t 

»  4YJf  -  3Pj(tf-T)  +  2F j  sin(Tf-x)  -  2Yjf  cos 

*  <Vlf  -  6YJf(tf-r)  *  4Y3f  sin  (t£'T) 

-  2Ylf  cos  (Tf-T)  (A-21J 


P2  *  *2f,j  ♦  2Pj  cos  t£  cos  t  ♦  2Yj£  sin  t£  cos  : 

*  2P,  sin  t-  sin  t  -  2Y,-  cos  t.  sin  t 

O 

«  -2P 3  ♦  2Pj  cos  (Tf-T)  ♦  2Yjf  sin  (Tf-T) 

.  -4YJf  ♦  4YJf  cos  (Tf-T)  ♦  2YJf  sin  (Tf-T)  (A-22) 

From  before, 

P3  ■  2YJf  CA-1J 


o 
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Lastly, 

P4  *  4YJf  *  3P3Tf  *  3P3T  *  4P3  cos  sin  T 

-  4Yjf  sin  if  sin  T  ♦  4Pj  sin  Tf  cos  T  -  4YJf  costf  cos  T 

*  <Ylf  -  3P j  (t£-t)  -  4YJf  cos  (xf-T)  ♦  4Pj  sin  (Tf-t) 

*  4Ylf  ‘  6Yjf  <VT)  *  4Yif  cos  (Tf-T) 

*  8YJf  sin  (Tf-T)  (A- 23) 

Thus,  the  costates  are  functions  only  of  the  terninal 

states  and  the  tine  to  go.  This  implies  that  the  control 

angle,  which  is  a  function  of  only  the  costates,  is  also  a 
function  only  of  the  terminal  states  and  the  time  to  go. 
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Appendix  B 

Non-linear  Tra j eetori ■ s 


This  appendix  displays  in  Figs.  21  through  26  the  actual 
optimum  non-linear  trajectories  defined  in  Chapter  IV, 

Table  I.  In  each  run,  the  pursuer  (  &  }  is  at  a  higher  alti¬ 
tude  than  the  evader  ( o )  and  the  pursuer  has  a  greater 
final  velocity  than  the  evader.  The  position  angle  THETA  is 
measured  from  the  position  at  the  final  time. 

These  trajectories  were  generated  by  assuming  the  final 
states  and  integrating  backward  in  time  as  discussed  in 
Chapter  IV.  Those  final  states  were  also  given  in  Chapter 
IV.  Other  constants  used  in  these  simulations,  but  which 
are  only  incidental  to  this  study,  are  listed  below: 

Vehicles'  weight  10,000  lb. 

Pursuer's  thrust  500  lb. 

Evader's  thrust  100  lb. 


Vehicles’  I  300  sec. 

*P 


It  has  been  assumed  that  the  mass  of  each  vehicle  is 
constant.  Actually,  in  a  real  case,  mass  (m)  would  be 
changing  by  the  expression 


m  •  Mq  ♦  mit 


where  Mfl  is  the  initial  mass,  m  is  the  propellant  flow  rate 


and  At  the  burn  time.  The  accuracy  of  the  constant  mass 
assumption  lies  in  the  magnitude  of  the  mAt  term.  The 


smaller  this  terra  in  relation  to  Mg,  the  better  the  assumption 
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A  Pursuer 
O  Evader 


THETfl 


Fig.  21.:  Optimum  Pursuer  and  Evader  Trajectories  in  terms  of 
Earth  Central  Angle  (Radians)  and  Radius,  Non-lincar  Run  1. 
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S  A  Pursuer 


Fig.  22.  Optimun  Pursuer  and  Evader  Trajectories  in  terns  of 
Earth  Central  Angle  (Radians)  and  Radius,  Non-linear  Run  2. 


300.00  320.00  340.00  360.00  380. 0Q 


GA/MC/72-7 


Fig- 

Earth 


A  Pursuer 
D  Evader 


-1.60 


~ i - 1 - 1 - 

-1.Z0  -0.80  -0.40 

THETA 


,  1 

O.GO  0.40 


23.  Optimum  Pursuer  and  Evader  Trajectories  in  terms  of 
Central  Angle  (Radians)  and  Radius.  Non-linear  Run  3. 


A  Pursuer 


THETA 


Fig.  25.:  Optimun  Pursuer  and  Evader  Trajectories  in  terns  of 
Earth  Central  Angle  (Radians)  and  Radius.  Non-linear  Run  5. 
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For  this  study,  »  10,000  Ib/g  *  310  lb  sec^/ft  while 

■  u  *  -0.0S17  lb  sec/ft  for  the  pursuer  and  five  times 

8  *P 

less  for  the  evader.-  Thus,  each  hundred  seconds  of  burn  time 

2 

would  decrease  the  pursuer's  mass  by  only  5.17  lb  sec  /ft,  or 
roughly  only  0.2%.  Thus,  it  is  felt  that  the  assumption  of 
constant  mass  is  justified  for  this  study. 

Also  shown  in  this  appendix  are  the  values  of  the  non¬ 
linear  separation  distance  between  the  vehicles  as  a  function 
of  time.  Again,  time  is  measured  relative  to  the  final  time. 
Thus,  time  is  actually  time  to  go.  It  can  be  seen  that  the 
plots  are  all  very  similar. 
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Appendix  C 

Discuss  ion  of  Computer  Solutions  to  the  TPBVP ' s 

This  appendix  discusses  some  of  the  computational 
aspects  of  the  solutions  to  the  TPBVP's  discussed  in  Chapter 
V.  All  computer  analysis  was  done  on  a  CDC  3600  computer 
system  with  a  Calcomb  plotting  device. 

Fixed-time  Solutions 

As  was  discussed  in  Chapter  V,  three  points  from  each 
of  the  six  backward  generated  non-linear  trajectories  were 
used  as  input  data.  Please  note  that  as  fixed-time  solutions 
it  was  assumed  that  the  time  to  go  corresponding  to  the  input 
data  was  known.: 

Since  the  program  used  actually  attempts  to  converge  to 
the  initial  (or  input)  data,  the  convergence  accuracy  desired 
relates  directly  to  the  real  computer  time  rea.uired  for  this 
convergence.;  The  runs  shown  in  Chapter  V  were  required  to 
converge  to  within  0.0001  of  the  input  values.  CUC  3600 
computer  processing  time  corresponded  almost  directly  to 
180  seconds  per  characteristic  time  unit.  That  is,  to  con¬ 
verge  to  input  from  1.0  characteristic  time  units  from  the 
terminal  state  required  180  seconds  of  computer  time.  Like¬ 
wise,  the  data  at  (t-t^)  «  -0.S  took  about  90  seconds  and 
the  data  at  (T-tf)  *  -0.2S  took  on  the  order  of  45  seconds.- 
Since  one  characteristic  time  unit  is  equal  to  about  806 
actual  seconds,  the  above  discussion  implies  that  given  a 


/ 


I 


1 
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o 


o 


o 


set  of  initial  conditions,  the  fixed-time  TPBVP  would  be 
solved  (converged  to  within  0.0001  of  initial  conditions}  in 
approximately  22\  of  the  remaining  time  to  go..  This  solution 
time  could  be  decreased  with  the  allowance  of  looser 
tolerances,  or  with  the  use  of  special  purpose  computers. 

Free-time  Solutions 

Since  in  the  free-time  problem,  the  actual  time  to  go 
corresponding  to  the  initial  conditions  was  not  known,  a 
somewhat  arbitrary  value  was  assumed.  A  fixed-time  solution 
was  then  generated  to  fit  this  particular  time  to  go.  The 
final  range  squared  rate  for  this  solution  was  calculated. 

Then  the  estimate  of  time  to  go  was  iterated  upon  to  drive 
the  final  range  squared  rate  to  tero.  Hence,  as  discussed 
in  Chapter  V,  the  free-time  solution  simply  selected  that 
fixed-time  solution  which  corresponded  to  the  minimum  final 
separation  distance. 

By  viewing  the  free-time  solutions  shown  in  Chapter  V, 
it  will  be  noted  that  in  all  cases  the  solution  for  time  to 
go  is  shorter  than  the  actual  time  to  go.  This  is  because 
the  initial  estimate  of  time  to  go  was  selected  to  be  smaller, 
as  discussed  before,  than  the  actual  value  and  the  program 
then  increases  that  value  until  the  terminal  range  squared 
rate  was  within  seme  tolerance  of  tero.  The  curves  shown 
required  that  tolerance  to  b.»  10*S.  A  few  runs  were  attempted 
using  10 *®,  but  the  convergence  had  not  occurred  after  50t  of 
the  tine  to  go  had  passed. 
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Also  important  is  the  desired  accuracy  with  which  the 
solution  meets  the  given  (neasured)  initial  states.  Remember 
for  the  fixed-time  solutions,  the  program  was  forced  to  meet 
these  states  within  0.0001.  Since  each  free-time  solution 
actually  .nvolves  several  fixed-time  solutions,  to  keep  the 
overall  convergence  time  to  within  acceptable  limits  this 
0.0001  tolerance  had  to  be  increased.  After  several  tries, 
it  was  found  that  0.002  would  work  with  fairly  acceptable 
results.  That  value,  then,  is  the  one  that  was  used  to 
generate  the  solutions  in  this  study. 
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Appendix  D 

Transition  Matrix  Derivation 

This  appendix  Mill  derive  the  individual  terns  that 
comprise  the  transition  matrix  ♦  discussed  in  Chapter  VII. 
From  the  theory  of  linear  equations. 


57  <*(Tf.T)lT  •  -{FCT)]T[*(Tf,t)lT 
with  the  boundary  condition 

(*(Tf,Tf)]  -  [I] 


CD-I) 


CD— 7  J 


where  I  represents  the  identity  matrix.  From  Chapter  VI,  F 
has  been  determined  to  be  a  constant  matrix: 


IF] 


0  1 

1  0 

-1  0 

0  -1 


C  0 
0  2 
0  1 
0  0 


Thus,  Eq  (D-l)  is  equivalent  to 


o 


'♦il 

*12 

♦is 

♦1/ 

A  « 

Ml 

♦12 

A  ' 

M3 

♦id 

♦il 

♦22 

♦is 

♦id 

m  - 

♦ii 

♦22 

A  » 

M3 

♦id 

♦il 

♦32 

♦33 

♦34 

♦si 

♦32 

♦is 

*34 

.♦il 

*h 

♦is 

♦44. 

6* 

♦42 

♦is 

♦id 

0  10  0 

10  0  2 

-10  0  1 

0-100 
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l*13‘*123 

C«14-*H) 

0 

(-*13-2^2 

v<1>23_*22i 

^24*^21^ 

0 

(-*23-2*22 

(»33**32> 

«34-*Sl) 

0 

<-*33-2*32 

^43*^42^ 

(*44-*41^ 

0 

(-*43'2*42 

which  is  actually  sixteen  equations  while  Eq  (D-2)  provides 
sixteen  boundary  conditions  at  the  final  time.  Since  the 
third  column  in  the  right  hand  side  of  Eq  (D-3)  consists  only 
of  zeros,  the  terms  corresponding  to  those  parameters 
(^13*  ^23'  ^33  and  *43^  aTe  a11  simP1y  constants  that  do  not 
vary  with  time.  Utilizing  the  boundary  conditions,  those 
constants  are  seen  to  be 


♦l3  "  ° 


(D-4a) 


*23  '  0 


(D-4b) 


♦33  *  1 


(D-4c) 


♦43  ’  0 


(D-4d) 


Now  from  Eq  (D-3) 
6' 

1 


-*14  *  *11 
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0 


o 


o 


*ii*  *  -*14  *  *n 


2*12  *  *il 


•'ll 


*Vi  *  *h  *  0 


Nornally,  the  solution  to  the  above  expression  would 
involve  terras  like  cos  T  and  sin  t.  However,  with  the  aid 
of  hindsight  and  the  fora  of  the  solutions  in  Appendix  A, 
let  the  solution  here  be  written  in  terras  of  T^  -  T,  or  At 


b  1 1  »  A  j  j  ♦  Bjj  sin  AT  ♦  Cjj  cos  At 


$u(Tf)  =  Au  ♦  Cu 


Thus 


A11  *  1  *  C11 


♦  n(t)  «  1  -  Cu  ♦  Bjj  sin  At  ♦  Cu  cos  At 


*  1  ♦  Bjj  sin  At  ♦  (cos  At  -  1)  (D-5a) 


Again  from  Kq  (L-3) , 
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21 

kt  ' 
P21 


22 

*22 


"*24  +  *21 


A  i  •  »  a  -A '  ♦  <£  ' 

921  924  921 


2*22  *  *21 


’""*21  *  *21 


-*21 


o 


As  before,  let 


At  1  1 
*21 


*21  *  0 


*21 

*  *21 

*  B21 

(Tf) 

*  A21 

*  C21 

N 

O 

sin  At  ♦  C21  cos  At 


A21  "  "C2 1 


Thus , 


o 


*2i CT )  *  ®21  sin  At  ♦  C21(cos  At  -  1) 
Again  from  Eq  (0-3), 


-5b) 
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*  1  .  A 

PS1  1  932 


A  »  *  *  -A  * 

*3i  *32 


♦si  *  *34 


♦Si'  *  *31  *  *34 


♦it  *  1  *  2*32 


Hi  4  1  *  2  *  2*31 


3  -  4 


31 


o 


Let 


nr  *  *3i  * 3 


Thus, 


*31  *  *31  *  B31  Sin  AT  *  C31  C0S  AT 


*31(tf>  *  A31  *  C31 


A31  *  'Si 


*31  *  B31  sin  At  *  Cjj(eos  Ax  -  1) 


-  3At 


3At 

(D-Sc) 
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Back  to  Eq  (D-3)  for 
*41  ' 


'*2 


r41 


42 


*41  ’  *44 


*  A*  -  A * 
Ml  Ml  M4 


*il  *  2*42 


*41  *  2*il 


-A41 


o 


whose  solution  is 


*4  i ' 

*  *il 

*  0 

*41 

*  *41 

*  B41 

(Tf) 

*  *41 

*  C41 

41 


Thus, 


A41  "  "C4 1 


o 


*41  *  B41  sin  fix  ♦  C^jCcos  it  -  1)  (C 


-Sd) 
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Now,  beginning  the  second  column  of  the  transition 
matrix 


A  *  -  A  ' 

9i2 


»  Bjj  cos  At  -  Cjj  sin  At 


*12(V  *  B11 


Thus 


*12  *  'Cll  Sin  AT 


(D-6a) 


and 


o 


*11  ’  1  4  cll(cos  AT  ■  15 


(D-6b) 


Also, 


*22  *  **21 


»  B21  cos  At  -  C2j  sin  At 


*22(Tf1  =  ®21 


Thus , 


*  cos  At  -  Cjj  sin  At 


(D-6c) 


o 
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Also, 


Thus, 


and 


Also, 


*21  «  sin  At  ♦  C2 j  cos  At 


*32  *  1  '  Hi 


n  -2  *  Bj.  cos  At  -  C j j  sin  At 


♦jj'V  *  *2  *  B31 


831  *  2 


♦J2  «  2  cos  At  -  C31  sin  At  -  2 


»  2  sin  At  ♦  Cjj  (cos  At  -  1) 


♦42  ■  -Hi 


«  B^j  cos  At  -  C^j  sin  At 


♦«2(Tf)  *  ®41 


o 
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(D-6d) 


(D-6e) 

3At 
(D-3f ) 


r 
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3 

Thus, 

^42  ”  'C4i  5in  *T 

CD-6*) 

V 

' 

and 

*41  ”  C41  (c05  4t  * 

(D-6h) 

Also 

*14  *  *12  +  *11 

»  Cjj  cos  At  ♦  1  ♦  Cjj  cos  At 

*  C11 

I 

n  2Cn  cos  At  ♦  1  -  c j j 

] 

*14(V  *  2Cn  ♦  1  -  Cn 

o 

■  C11  *  1 

«  0 

or 

Cji  .  -1 

Thus 

♦j4  *  -2  cos  At  ♦  2 

CD- 7a ) 

1 

end  fron  Eq 

(D-6a) , 

■  3in  At 

ID- 7b) 

o 
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Thus 


Fron  Eq  (0-6b) , 


*11  *  1  *  (cos  iT  '  ^ 


«  2  -  cos  At 
A**  in  from  Eq  (0-3) , 


(D-7c) 


t  «  *•  ♦  *• 

*24  *22  * 21 


sin  At  ♦  C21  cos  At  ♦  sin  At 
♦  C21  cos  At  -  C21 


2  sin  At  ♦  2  C21  cos  At  -  C2J  (D-8) 


*24(Tf)  ‘  ZC21  ‘  C21 


"21 


*  2  sin  At  (D-9a) 

24 

Also,  from  Eq  (E-6c), 

*22  *  C0S  *T  (D-9b) 

Froa  Eq  (E-6d)  , 

♦21  *  sin  At  (D-9c) 

Once  wore  using  the  original  expression  from  Eq  (0-3), 


112 


r 


o 


o 
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*34  "  *32  *  *31 


*  2  sin  At  ♦  Cjj  cos  At  ♦  2  sin  At 


♦  C31  cos  At  -  C31  -  3AT 


*  4  sin  At  ♦  2Cjj  cos  At 


*  C3 1  * 


(D- 10) 


*34<V  *  2t31  *  C31 


»  C 


31 


Thus 


$J4  *  4  sin  At  -  3At 


(D- 11s) 


and  from  Eq  (D-6e) , 


32 


*  2  cos  At  -  2 


(D-llb) 


and  from  Eq  (b-6f } , 


r31 


*  2  sin  At  -  3At 


(D- 11c) 


Now,  lastly  from  Eq  (D-3), 


i  •  *'  ♦  t 

*44  *42  *41 


C^j  cos  At  ♦  C41  cos  At  -  C4J 


»  2C41  cos  At  -  C41 


(D- 12) 
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♦44(tf)  -  2C41  -  C41 


«  C 


41 


Thus, 


«  1 


♦44  »  2  cos  it 


and  froa  Eq  (D-6g) , 


♦42  *  -  sin  At 


Froa  Eq  (D-6h) , 


o 


«  cos  At  -  1 


And  now,  finally,  Eqs  (0-4),  (D-7) ,  (D-9) ,  (0-11)  and  ( 
constitute  the  solution  to  the  transition  natrix.  Thus 

r 


[♦] 


(2  -  cos  At) 

(sin  At) 

0 

(2 

-  2 

cos 

(sin  At) 

(cos  At) 

0 

(2 

sin 

At) 

(2  sin  At  -  3At) 

(2  cos  At  -  2) 

1 

sin 

At 

(cos  At  -  1) 

(-sin  At) 

0 

(2 

cos 

At 

1 1*5 


(D-13a) 

(D- 13b) 

(D- 13c) 
D- 13) 

At) 

3At) 

1) 


o 
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